(NASA-CR-199324) THE MINIMAL TIME 
DETECTION ALGORITHM (California 
Un i v. ) 13 p 


N96-15989 
Unci as 


G3/61 0065148 


NASA-CR-1 99324 


/A -C>/-C-g_ 

a S7H S 

The Minimal Time Detection Algorithm 1 ?' 

Sungwan Kim 

Electrical Engineering Department 
University of California, Los Angeles 

Abstract — An aerospace vehicle may operate throughout a wide range of flight environ- 
mental conditions that affect its dynamic characteristics. Even when the control design 
incorporates a degree of robustness, system parameters may drift enough to cause its 
performance to degrade below an acceptable level. The object of this paper is to develop 
a change detection algorithm so that we can build a highly adaptive control system appli- 
cable to aircraft systems. The idea is to detect system changes with minimal time delay. 
The algorithm developed is called Minimal Time-Change Detection Algorithm(MT-CDA) 
which detects the instant of change as quickly as possible with false-alarm probability be- 
low a certain specified level. Simulation results for the aircraft lateral motion with a 
known or unknown change in control gain matrices, in the presence of doublet input, in- 
dicate that the algorithm works fairly well as theory indicates though there is a difficulty 
in deciding the exact amount of change in some situations. One of MT-CDA distinguish- 
ing properties is that detection delay of MT-CDA is superior to that of Whiteness Test. 


1. Introduction 

We wish to design an aerospace vehicle control system which operates throughout a wide 
range of flight environmental conditions that affect its dynamic characteristics. The prob- 
lem of identifying aircraft system parameters from flight test data and their application to 
flight control has been successfully solved for linear models, by Balakrishnan [2], Iliff [11], 
and Maine [15], [16], when there are no severe changes in aircraft and environment. Even 
when the control design incorporates a degree of robustness, system parameters may drift 
enough to degrade its performance below an acceptable level. In other words, we still 
need to develop a theory for a better control system when aircraft flies at a high angle of 
attack where the linear model is no longer valid and when the robust controller does not 
work due to large variations in parameters or noise levels. 

Adaptive controls are considered to be a promising approach to give us a possible 
solution. An adaptive control problem arises whenever system parameters are unknown 
or are subject to unknown variation which is usually a small (or smooth) change. It is 
also of increasing practical importance, since adaptive techniques are being used more 
and more in industrial control systems. However, this field is not mature yet, and only a 
set of scattered simulational results exists with no single quantitative measure for judging 
performances [1]. Taking into account abrupt (or drastic) changes in statistical models 
appears as a natural complement of most of the adaptive techniques which track only slow 
variations of parameters. So, the detection of abrupt change is essential in the design of 
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an adaptive system for these types of adaptive control problems. Therefore, the problem 
of detection, estimation, and diagnosis of changes in dynamical properties of signals or 
systems are considered, with particular emphasis on statistical methods for detection, to 
provide a general framework for change detection in signals and systems. 

The development of the change detection problem was stimulated by Wald [25] in 1947 
when ‘Sequential Analysis’ was published and a Sequential Probability Ratio Test(SPRT) 
was introduced. In 1954, a ‘sequential process inspection scheme’ was proposed by Page 
[18], [19] to detect a change in the mean by testing a weighted sum of the last few obser- 
vations, i.e. a moving average. Named the ‘Page-Hinkley’ rule, Page pointed out that this 
rule is equivalent to performing a SPRT. The theoretical properties of this rule have been 
investigated for a long time from on-line and off-line points of view. The most significant 
works in that direction are Shiryayev [21] and Lorden [14]. They formulated an ‘Opti- 
mal Stopping (or Detection)’ problem and proposed simple rules which are optimal (or 
asymptotically optimal) in an appropriate sense. And the general problem of optimality 
of random processes in discrete time was considered and developed by Chow, Robbins, 
and Siegmund [7]. The problem of change detection has received growing attention during 
the last 20 years, as can be seen from the survey papers (Wilsky [27] and Basseville [4]), 
the books (Basseville and Benvensite [5], Basseville and Nikiforov [6]) and so on. Further 
discussions may be found in these References. 

The development of change detection method is still a relatively new subject. Presently, 
most of the work has been at a theoretical level with only a few real applications of tech- 
niques: edge detection in pattern recognition, segmentation of speech (or image) signal, 
biomedical signal monitoring, vibration monitoring, quality control, fault-detection, etc. 

As mentioned earlier, an algorithm is required to adapt to new circumstances for a 
total adaptive system applicable to the aircraft control systems. One important new 
idea is an algorithm to detect system change with minimal time delay that involves fairly 
advanced stochastic theory. This could be formulated based on the problem of an optimal 
stopping rule [21] in which we seek to detect the instant of change as quickly as possible, 
subject to the given false-alarm probability. 

A block diagram shown in Figure 1 explains the total adaptive system for the aircraft 
control that is equipped with a CD A. Before the CD A detects a change, the regulator is 
designed based on the initial parameter values. But after the change is detected at time 
r, the CD A block generates an Activation Signal to re-initiate system identification. The 
system identification process finds a new set of parameter values proper for the changed 
system. The regulator uses the new parameter values to build a new control law. This 
process is continued until the new parameter set converges. So, a total adaptive control 
system can be designed that is good for a system that undergoes changes. 

Algorithm complexity is definitely an issue for detection of each possible change and 
time of change. In spite of this complexity, we can have a control system which can detect 
its change and adapt it as quickly as possible even though the large amount of change is 
occurred at random time. Therefore, this MT-CDA will present a proper starting point 
for total adaptive control system in the theoretical point of view. 
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Figure 1: A Block Diagram of Control System for Aircrafts with CDA 

2. Minimal Time-Change Detection Algorithm 
2.1. MT-CDA: Detection of a Known Change 
The following state space model is considered. 


x n+ i = Ax n + (Bi + (jB 2 - Bi)x{n - 9))u n 


( 1 ) 


V n = Cx n + ( Di + (D 2 - Di)x{n - 9))u n + GN n . 


( 2 ) 


x(ra) 


f 0 if m < 0 
| 1 if m > 0 


(3) 


Based on the Eq.(l) and (2), the basic problem to be solved is to detect a known change in 
control gain matrices(jB and D ) as quickly as possible in order to build an highly adaptive 
system whose parameters^ and D ) could be switched from a known system to another 
known system after change detection. This is appropriate for a system which operates 
in two alternate driving points, and restricted to the class of models with a change of 
parameters which is known. The probability of making a false (or wrong) detection also 
needs minimized since the signals are disturbed by a white Gaussian noise. 

We want to formulate a problem which is to find the detection time(r) to minimize 
the average delay 


E[(r - «)+] 


subject to a given false alarm probability, i.e. 


(4) 


Pr.[r < 0] < a 


(5) 











where a is given. ‘Likelihood Ratio (change vs. no change)’, which we 
the ratio 

shall define to be 

Joint density of t>i, • • • ,«„ (with change) 
Joint density of tq , • • • , w n (without change) 


is introduced and p(-), p 0 Q (-) denote the likelihood probability density function with and 
without changes at 6 = k. 

. p(v = k ) =p(vi,“-,v k ,v k+ i,---,v n \9 = k) 

(6) 

Poo(vi,v 2 ,--‘ ,v n ) = p(vi,- • • ,v n \9 > n ) 

(7) 

Then we define the following functional 


T o, A v u v ^-’- ,v n \6 = k) 

L n k = 2 log . 

Peo(«l)t>2, •*•,».») 

(8) 

and for each n, 


= L n lc • 

k<n 

(9) 

Now a decision rule for CDA is 


r = min{n : I n > h} 

(10) 


where r is a change detection time and h is a threshold value computed from the proba- 
bility of false alarm equation(Eq.(5)). 

This algorithm stops the first time when l n exceeds a given threshold. This is based 
on Eq.(8)-(10), so it can be regarded as ‘Maximum Likelihood’ treatment of the unknown 
change time, i.e. stop at r = n when for some k the observations v k , ■ • • , v n are significant. 

By the contributions of earlier works of Shiryayev [21], Lorden [14], Bansal [3], and 
Tartakovsky [23], [24] this procedure could be said optimal (at least asymptotically op- 
timal), in the sense that it minimizes the detection delay for a fixed false alarm probability. 

2.2. MT-CDA: Detection of an Unknown Change 

In this section, minimal time detection of an unknown change instead of a known change 
is considered, and its algorithm is derived. The detection of an unknown change is a more 
complicated problem than the detection of a known change because there is no information 
on the amount of change. Multiple detectors are required to detect an unknown change, 
where the each detector is based on the known amount of change, in contrast to single 
detector required for the detection algorithm of a known change. In Section 2.2.1, the 
algorithm for the detection of only change time, which is a little bit simpler problem, is 
first derived and the detection algorithm of both time and amount of change is followed 
in Section 2.2.2. 

2.2.1. Detection of the Time (or Instant) of Change : The detection of change time is 
a significant problem in some applications, for example, 


1. Fault detection : all the processes are stopped when a failure occurs and are re- 
started after the failure is fixed. 

2. When a system requires the exact parameter set after a change, it is preferable to 
re-initiate the system identification just after detecting a change. 

In adaptive system sense, the 2nd case is a popular one and a promising problem to 
be considered [9]. To detect an unknown change, the CD A Block in Figure 1 contains 
multiple change detectors. Each of (CDA), is based on a fixed known change, so each of 
detectors is basically the same one as derived in Section 2.1. By examining the Activation 
Signal for each n, the real Activation Signal at time n is generated by the earliest one. The 
idea of this algorithm is that if there exists an unknown change, the exact (or the closest) 
detector will make Activation Signal at the earliest time. So the time of an unknown 
change will be detected with this algorithm if the amount of an unknown change is in the 
range of the multiple detector hypotheses. 

To formulate this MT-CDA for an unknown change, we consider the following system 
model 


rr n+ i = Ax n + (Bt + ( B 2 - l?i)x(n - B))u n 


( 11 ) 


v n — Cx n + ( D\ + (D 2 — Di)x(n — 0))u n + GN n (12) 


B 2 ,D 2 -- unknown. 

The only difference, compared to the Section 2.1, is that control gain matrices(jE ?2 and 
D 2 ) are unknown which stands for the unknown change. Like Section 2.1, we define the 
following functional, which is related to ‘Likelihood Ratio’, for each detector 

T i „ , p{v\,vi, - ■ ■ ,v n \0 = k,B 2 = B' 2 ,D 2 = D\) 

n ’ k ° S p(vi,v 2 ,--- ,v n \0 > n) 

where each superscript ‘F stands for Fth detector (i = 1,2,---, iV) and for each n and 
each detector, 



l ' = max U , . 

n k < n n,k 

Then the decision rule for the detection of an unknown change is 

t‘ = min{n : t n > ti) 


(14) 


(15) 


r = min r* 

t 


(16) 


where r* is a change detection time of each detector, r is a real change detection time, 
and h' is a threshold value for each detector which is found from the probability of false 


alarm equation. So we can detect this kind of unknown change at time r which is the 
earliest detection time among all the multiple detectors considered in this algorithm. To 
have a good detection algorithm, the number of change detectors(TV) should be sufficiently 
large and the dynamic range of detectors’ change amount should be sufficient to cover the 
estimated range of changes in system parameters. This means that there exists a trade- 
off relationship between ‘Performance’ and ‘Complexity’ of the algorithm because the 
computational burden increases dramatically as the number of change detectors increases. 

2.2.2. Detection of the Time and Amount of Change : In some applications, it is 
insufficient to detect only the change time if the change is unknown, it is also required to 
detect the amount of change. Figure 2 is a modified block diagram of Figure 1 for this 
purpose. CDA Block is a change detection algorithm which can estimate the amount of 
an unknown change and the change time. It generates the Activation Signal(AS') and 
an Estimated Degree of Chang e(EDC) which is closely related to the real amount of 
change limited by the resolution of the detectors. When the system change is detected, 
the system parameter set is updated based on EDC and Parameter Update Block that 
rules the parameter update law. There is no necessity of System Identification routine. 
This looks simpler than the adaptive control system explained in Section 2.2.1, but the 
CDA Block is much more complicated than CDA Block. So, Figure 2 could be considered 
another version of block diagram for the total adaptive control system that is appropriate 
for a system that undergoes an unknown change in parameters. To determine the amount 



Figure 2: A Block Diagram of Control System for Aircrafts with CDA 


of change, a ‘Decision Mechanism’ is required. Based on the AS, each of that comes from 
a known change detector, the Decision Mechanism generates a real one and an EDC at 
time n. The algorithm formulation is the exactly same as Section 2.2.1 (Eq.(ll)-(16)) 
except the Decision Mechanism, so only the details of Decision Mechanism is explained 
in the following. 

r* = min{n : P n > h*} (17) 








(18) 


r = min r* 

i 


k = min{z : t'}. (19) 

We can then detect an unknown change at time r whose EDC is equivalent to the /c-th 
detector, if the amount of an unknown change is in the range of the amount of multiple 
detectors. The difficulty of the decision of the exact EDC exists in decision rule(Eq.(17)- 
(19)), called ‘D.R. # 1’ hereafter, because some of change detectors could respond at the 
same time. That means the necessity of a better decision rule. Because the exact value 
of i' n (‘exact’ means the exact or the closest change detector corresponding to the given 
unknown change) is rapidly increasing, the following new decision rule, called ‘D.R. # 2’, 
could be proposed. 

r* = min{n : i' n > h 1 } (20) 

r = minT* (21) 


{ max{i : (£' n — h')} if 3 more than 2 minimum r* 
min{? : r‘} otherwise. 


( 22 ) 


There exists the same trade-off between performance and the complexity of the algorithm 
explained in Section 2.2.1. Only a finite number of change detectors are used in real 
simulations. 


3. Simulations and Results 

A lateral rigid body dynamics of PA-30, which is a Linear Time-Invariant(LTI), is used 
for simulations [12], [17]. 

3.1. Detection of a Known Change 

The mean(M[-]) and the variance(V[-]) of detection delay(r — 0), with respect to the 
different change time(0), based on 100 runs hereafter, are summarized in Table 1. 50% 
change is detected earlier than 25% or 10% change. From the result of Table 1, it is shown 
that different known changes could been detected with some delays. 

3.2. Detection of an Unknown Change: Time only 

Simulations with 6 change detectors are done first and then combined to analyze their 
results as summarized in Table 2. From this Table, the followings are observed: 

• For a given detector, large amount of change is detected earlier than small amount 
of change. 
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Table 1: Simulation Results for Various Change Times when Change is in Rolling Motion 

• Rolling motion : 

- 10% Change:50%D > 25%D > 10%D 

- 25% Change: 10%D,50%D > 25%D =* 10%D,50%D ~ 25%D 

- 50% Change: 10%D > 25%D > 50%D => 10%D ~ 25%D ~ 50%D 

where ‘D’ denotes a detector and the detection delay is quite reduced when 10% 
detector is used to detect 10% change but there is no big difference in detection 
delay of 3 change detectors to detect 25% or 50% change. 

• Yawing motion : The results are the same as rolling motion, but detection delay is 
large and the difference of delay with respect to each change detector is small since 
the portion of yawing motion in PA-30 is small. 

From the above observations and the trade-off between the number of change detectors 
and the computational burden, it could be concluded that 10% change detector is suffi- 
cient when the detection of change larger than 10% is concerned. 


3.3. Detection of an Unknown Change: Time and Amount 

Simulation results, with D.R. # 2, for 6 = 40 are summarized in Table 3. From this table, 
it could be shown that the unknown changes at 0 = 40 are fairly well detected except 30% 
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R.D. 

Y.D. 

R.D. 
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R.D. 
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Table 2: Summarized Simulation Results for 9 = 30 
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Rolling Detector 
Yawing Detector 
Rolling Change 
Yawing Change 
No Detection 


and 40% changes, which might be fixed if the better decision rule is applied. Simulation 
results for 9 = 10, 20, and 30 have the same characteristics. 

Therefore, it could be concluded that the given unknown changes are detected in sta- 
tistical sense, though there exists a difficulty in deciding the exact EDC in some situations 
which might be improved by applying the better decision rule. 

3.4 Change Detection via Whiteness Test 

To examine the validity of MT-CDA, derived in Section 2.1 and 2.2, simulations of White- 
ness Test are done and results are compared in this section. Only the detection problem 
of a known change is considered here. 

Table 4 shows the detection delay of each algorithm for various change time(0). For 
every tests, the detection delay of MT-CDA is smaller than that of Whiteness Test. 
Therefore, the simulation results show that MT-CDA is superior to Whiteness Test in the 
sense of detection delay comparison. 
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Table 3: Simulation Results for 6 = 40 
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Table 4: Simulation Results for Various Change Times when 25% Change is in Rolling 
Motion 

4. Conclusions 

A simple model with a single change in parameters of control gain matrices (B and D) at 
random time whose a priori distribution is known has been considered. Changes in these 
matrices mean the failure in the actuators, so possible damages in the control surfaces 
(aircraft wings) and/or one of the engine failure could be analyzed with this model. 
Therefore, considering changes in the control gain matrices is the proper starting point 
before we consider all kinds of changes. MT-CDA, based on Likelihood Ratio Test, for 
this simple model has been developed whether a change is known or unknown and it has 
been shown to be optimal for a fixed false alarm probability. 

Simulation results for lateral motions show that a known change can be detected with 
some delays which should be minimal for the given condition as theory indicates. The 
detection problem of an unknown change is much more complicated because there is no 
information on the amount of change. It requires multiple change detectors where each 
detector is based on the known amount of change. This problem is considered in two ways: 
the detection of change time only and the detection of both time and amount of change. 
The former algorithm is a little bit simple but it requires a system identification routine 
to build a total adaptive system. Due to the trade-off between the performance and the 
complexity (number of change detectors), only a finite number of change detectors are 
used for simulations. From simulation results for the detection of change time, it could be 
concluded that 10% change detector, which is the smallest one, is sufficient and it is robust 
in the sense that it could detect any change(> 10%) with sub-minimal detection delay. 
And the unknown change is detected, in statistical sense, though there exists a difficulty 
to decide the exact EDC in some situations. The better (or best) decision rule needs 
to be developed to solve this difficulty. The algorithm with multiple change detectors, 
if implemented in full, will yield the best performance for the widest class of change. 
But full implementation is another problem. Simulations have been done throughout the 






























































various situations and the results are meaningful. Detection via Whiteness Test has been 
also formulated for algorithm comparison in the sense of detection delay. MT-CDA is 
superior to the Whiteness Test in this sense. 

In this paper, MT-CDA has been developed and demonstrated by simulations when a 
change is in control gain matrices. With this MT-CDA, a total adaptive control system 
shown in Figure 1 or Figure 2 could be built and work throughout a wide range of 
conditions. 
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